NOTES ON CONTINUOUS RANDOM WALKS 
BY 
MICHEL VAN DEN BERGH 


The formula which is implemented in the Fishtest Framework is (6.1). It is 
basically [1, Corollary 3.44]. However I first derived the formula myself before I 
discoved this reference and I was too lazy afterwards to do the translation. 


1. CONTINUOUS RANDOM WALKS 


We discuss a continuous 1-dimensional random walk with drift 2 and variance 0? 
per time unit. We assume there is some boundary C in the «x — ¢-plane (¢ is the 
time coordinate and z is a spatial coordinate, by convention we assume that t is 
horizontal) such that if the random walk touches C' there is a payoff of ¢)(z, t). 

Let P(a,t) be the expectation value of the eventual payoff for a particle at (a, t) 
Then the value of P(z,t) is governed by the following diffusion equation 

OP OP <g7 O7P 
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2. STOPPING TIME 


The stopping time S' is defined as the first time that the random walk touches 
the boundary of an interval of length A. Below we compute the probability density 
of S. 

To do this we first compute the probability that S is larger than a given con- 
stant T. Le. P(S > T). To do this have to solve (1.1) with the boundary conditions 
P(0,t) = P(A,t) = 0 for t < T and P(xz,T) = 1. We will look at the more general 
problem where P(x,T) = w(2). 

Using separation of variables P(x,t) = X(x)T(t) we have to solve 


with X(0) = 0, X(A) =0. 
The roots of the characteristic equation of the last equation are 
—pt /p? — 207A 


X1,2 = 
o2 


It follows that we should have 
A=207— p? >0 
and the general solutions are 


eT tHe sin aVA/o? 
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as the cosine solutions are excluded by our boundary condition X(0) = 0. The 
boundary condition X(A) = 0 leads to 


AVA/o? = nr 


which leads to the following values for \: 


‘ nemo pe 
BO DAZ 20? 
Hence our general solution is now 
2 . 
ernt-tH/o" sinnaa/A 


We look for a, such that 
x dnernt—tH/o” sinn7a/A = v(2) 


or equivalently 6,, such that 
> by sin n7a/A = eV” (x) 


where y = 1/0? and by, = ane*”*. Standard Fourier analysis yields 
9 fA 
b= Sf errsin vy) dy 
\T dt nmx}2 [4 . nry 
(2.1) P(a,t) = ae Neo sin 5 e™ sin ab) dy 
Our original problem corresponds to 


sem {t OSes 


So the solution is 


0 otherwise 


Thus the probability that the stopping time S$ is > T is 


a Be ny 
—AnT ¢ YY ot 
P(S>T) a e€ msi gE |S e€ sn a 


For the sequel it will be convenient to define 


2 
H,,(y, 2) = 3 fet sin ae 


_ 2Aye7™ sinanx/A — 2rne™ cosmnx/A 


A2y2 + 72n2 
In particular we have the following special values 
27 
Hal 0) = — Janae aint 
Qnn et 


A, (y, A) = —(-1)" 


A2,2 + 72n2 
so that we find 


P(S>T) = 2" nT—9 (FT, (y,A) — H,,(7,0)) sin 
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From this we compute the expected stopping time. The probability distribution of 
S is 

S=T) = Snot -1(Aa (7, A) — Hn(7,0)) sin —— 

o(S = 7) =) ne (Hy (7A) — Ha(,0)) sin 


so that 
NTX 


1 
E(S) = » a Ma A) — H,,(7,0)) sin ar 
Assume now that the experiment is truncated at a certain fixed time T. Then the 
modified stopping time is 


ie 
2 ee ES ee 
Taking into account that 
Ti rt |F 
t+1 ik 
| wie igre — Ot De = =(1-—(TA+1)e"™) 
0 r o A 


we find 
NTL 


E(S') =P(S>T)T+)~ —(I-(Trn te? Jen A)—H,(7,0)) sin ae 


3. THE PROBABILITY THAT THE PARTICLE HITS t= 7, x < y BEFORE HITTING 
THE UPPER OR LOWER BOUNDARY 


In this case we must use (2.1) with 


1 a<y 
GS 
wey={h 253 
Thus we find 
S ore ee 
P(a,t) = De Pe! (Hn (yy) — Hn(7,0)) sin [- 


So the probability that a particle starting at (0,2) hits the interval [(T,0), (T, y)] 
before hitting the boundary is 


opine _ nTx 
doe eh (Hin, ¥) — Hn (7,0)) sin S— 


4. 'THE PROBABILITY THAT THE PARTICLE TOUCHES THE UPPER BOUNDARY 
BEFORE TIME T' 


We must solve the boundary value problem for P with P(0,t) = P(z,T) = 0, 
P(A,t) =1. 

We first look for a Q(x,t) solution indendent of t which satisfies Q(0,t) = 0, 
Q(A, t) = 1. Such a solution is of the form 


C+De~** 
for suitable constants C, D. The boundary conditions give the following constraints 
C+D=0 
C+ De—774 =1 
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which leads to 


1 
o> e-27A — J] 
1 
ae e274 — J] 
Hence the solution has the form 
e727 _] 


Consider now 
PGi) — P24) a1 Q(z, t) 
Then P’(0,t) = P’(A,t) = 0 for t < A and 


P'(x,T) =—- 
so that using (2.1) 


1 
/ ets ee 
a oe e274 — | A 


_ tt, TIDE 
y gaat phe Ie ein 
n 


So the ultimate solution is 


—2yx 

e —l 1 NTL 

P(az,t) = ) e Ant eAnt—7 gi 
( 2 ) e274 ara | e274 —]1 


which can also be written as 
e7 27% 1 1 


= —AnT pAnt—ye o7,, UAL 
POO = raat maa ose A Ba) 
Using the definition of H,,(y, A) this becomes 
(4.1) 
e7 27% 1 1 ny dT Mote pomn(eVA - ev) _ nTrx 
P@,!) = aa] ena ay (—1)")e~AeT ernt-7 Pane | 
eo 27% _ 1 A ae eee Qrn _ nt(A—2x) 
ae = eae ee ye wea Ab? + en? A 
e777 _] = are . Tx 
= aaa Sie AnT pAnt-7 H(y, A) sin a 


n 


So the probability that a particle starting at (0,2) hits the interval [(0, A), (T, A)] 
before hitting the lower boundary is. 


e271 — 1 _)\ T_-+n . Tx 
aa Se ag A) sin 
Put T = oo get that the probability that the particle hits [(0, A), (co, A)] is 
e7 27% — J 
e274 — 1 
hence the probability that it hits [(T’, A), (co, A)] is 
nTe 


SS e Ant -72 (4, A) sin os 
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5. THE PROBABILITY THAT THE PARTICLE TOUCHES THE LOWER BOUNDARY 
BEFORE TIME T' 


To get the probability that the particle touches the lower boundary first we have 
to make the substitutions x H A— 2, ws —y (and hence y +> —7). Note that 
Hl =, A) = (—1)"e-74 A, (7, 0) 
So the probability that a particle starting at (0,x) hits the interval [(0,0), (7, 0)] 
before hitting the upper boundary is. 


erA-z) — 4 T+ ni(A— 2) 
a —AnT+7(A-2)(_1)%e-7A ; 
Fe ea : € (—1)"e"”* A, (4, 0) sin A 
eer). 4 NTL 


= —AnT- yx s 
>= + Sie % H, (7, 0) sin ]— 


6. THE PROBABILITY THAT THE PARTICLE PASSES BELOW (T,y). 


Combining everything we get that the probability that a particle starting in 
(0,2) leaves the rectangle [0,T] x [0, A] in a point below (Ty) where x, y € [0, A] 
is given by 


e21(A-2) =r 


(6.1) AR] 


eH (qyy) sin 
n 
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